Papers with max pooling
Enhancing Sentence Embedding with Generalized Pooling (C18-1)
Copied to clipboard
| Challenge: | Existing methods for learning sentence embedding are limited, but still need to be improved. |
| Approach: | They propose a vector-based multi-head attention model that uses special cases of max pooling, mean pooling and scalar self-attention. |
| Outcome: | The proposed model improves on natural language inference, author profiling, and sentiment classification tasks. |
Combining Distant and Direct Supervision for Neural Relation Extraction (N19-1)
Copied to clipboard
| Challenge: | Existing methods to train relation extraction with distant supervision use noisy labels and implicitly assumes that all the KB facts are mentioned in the text. |
| Approach: | They propose to combine distant supervision data with additional directly-supervised data to train relation extraction models by using sigmoidal attention weights with max pooling. |
| Outcome: | The proposed method achieves state-of-the-art on the widely used FB-NYT dataset. |
Strong and Light Baseline Models for Fact-Checking Joint Inference (2021.findings-acl)
Copied to clipboard
| Challenge: | Automated fact checking is rapidly gaining attention of the NLP and AI communities. |
| Approach: | They propose lightweight strong baselines for automated fact-checking systems . they propose to combine multiple pieces of evidence to verify a claim . |
| Outcome: | The proposed methods outperform heavier models on the leaderboard with blind TEST set. |
Sequential Learning of Convolutional Features for Effective Text Classification (D19-1)
Copied to clipboard
| Challenge: | Existing models for text classification have largely ignored convolution filters and max pooling . text classification is one of the major applications of natural language processing . |
| Approach: | They propose a convolutional attentive recurrent network model which uses convolution filters and max pooling to improve text classification. |
| Outcome: | The proposed model outperforms existing convolutional models on text classification tasks. |